The Last Piece of the Puzzle: Vibing an Inference Engine
After finishing AIMA's management layer and after-sales service layer, I realized one piece was still missing. Ollama is too simplistic, llama.cpp loses precision to its own format, and vLLM is too heavy. With no off-the-shelf solution on the market, I'll build it myself.
7 min read